Image processing system

ABSTRACT

An image processing apparatus includes a pick-up for picking-up a subject, temporal storage for temporarily storing sets of image information picked up by the pick-up during predetermined time periods, and a display for displaying the stored sets of image information and image information from the pick-up. A subject views the display during image pick-up. Also included is a control that causes temporal storage to store the sets of image information corresponding to the same subject picked up by the pick-up during the predetermined time periods, and causes display of the sets of image information corresponding to the same subject and stored in temporal storage discriminatively from the image information from the pick-up. At least one of the sets of image information is selected corresponding to the same subject in temporal storage.

CROSS REFERENCE TO RELATED APPLICATIONS

This application is a divisional of Ser. No. 08/958,742, filed Oct. 27,1997, now U.S. Pat. No. 6,147,704, which was a continuation of Ser. No.08/732,915, filed Oct. 17, 1996, now abandoned, which was a divisionalof Ser. No. 08/339,880, filed Nov. 14, 1994, now U.S. Pat. No.5,617,138, which was a continuation of Ser. No. 08/026,181, filed Mar.1, 1993, now abandoned, which was a divisional of Ser. No. 07/788,302,filed Nov. 5, 1991, now abandoned.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to an image processing system forphotographing an object and printing a photographed image.

2. Related Background Art

Conventionally, photo booth apparatuses have been provided forautomatically taking a picture for the identification card or passportwith the input of a coin, in which the apparatus comprises a camera, aphoto developing unit and a flash with the optical silver saltphotography.

However, with such apparatuses, due to pollution problems resulting fromthe use of chemicals to develop the photo, some limitations were imposedon the installing location, or great labors were taken for themaintenance of apparatus.

Also, it took some time to perform the chemical processing fordevelopment, so that the user had to wait for a picture to be completedfor about five minutes, after the picture was taken.

Furthermore, there was a drawback that a photographed result was notseen until it was developed, and if the photographing might fail, thesheet was wasted or the fee was charged irrespective of the failurebecause the picture had been already printed on the sheet.

Also, it was impossible to take a plurality of photographs and printonly the best photographed picture among them.

Furthermore, there was a drawback that when supplies were used up or theapparatus might fail, the service was only inhibited, and an abnormalcondition of the apparatus could be first detected by a service man inthe round inspection, so that the user could not use the apparatus for along term, which was inconvenient for the user and unprofitable for thedealer.

Also, since the black-and-white apparatus and the color apparatus wereseparately provided, it was necessary to search about for an apparatuswhich allows a desired picture to be taken.

Furthermore, there was a drawback that if various functions wereinstalled, the cost would be raised.

Furthermore, it was impossible to print images other than thosephotographed with the same apparatus.

SUMMARY OF THE INVENTION

The present invention was achieved in view of the above-mentionedrespects, and its object is to provide an improved image processingapparatus.

Further, it is an object of the present invention to provide an imageprocessing system without anxieties of the pollution.

Further, it is an object of the present invention to provide an imageprocessing system with a simple construction and of an easy maintenance.

Further, it is an object of the present invention to provide an imageprocessing system which is always available to the user, and capable ofrapid processing.

Further, it is an object of the present invention to provide an imageprocessing apparatus which allows a photographed result desired by theuser to be printed.

Further, it is an object of the present invention to provide an imageprocessing apparatus which allows a failure of the apparatus to bedetected at early time.

Further, it is an object of the present invention to provide an imageprocessing system capable of printing both the color and black-and-whitepictures.

Further, it is an object of the present invention to provide an imageprocessing system which allows various functions to be implemented atlow cost.

Further, it is an object of the present invention to provide an imageprocessing system which allows various images to be printed.

Other objects and features of the present invention will be apparentfrom the following description and the drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a block diagram of an image processing system in an example ofthe present invention.

FIG. 2 is an external view of the image processing system in theexample.

FIG. 3 is a flowchart of the operation in a system control unit 16 asshown in FIG. 1.

FIG. 4 is a flowchart of another operation in the system control unit 16as shown in FIG. 1.

FIG. 5 is a block diagram of an image processing system in anotherexample.

FIG. 6 is a block diagram of a centralized supervisory system for makingthe centralized supervision of a plurality of image processing system.

FIG. 7 is a flowchart of the operation in a system control unit 16 asshown in FIG. 5.

FIG. 8 is a table showing the signals indicating the states of a printer18 as shown in FIG. 5.

FIG. 9 is a specific circuit diagram of a communication unit 31 as shownin FIG. 5.

FIG. 10 is a block diagram of an image processing system in anotherexample.

FIG. 11 is a flowchart of the operation in a system control unit 16 asshown in FIG. 10.

FIG. 12 is a view showing a mark indicating a print region displayed ona monitor 14.

FIG. 13 is a flowchart of the printing as shown in FIG. 10.

FIG. 14 is a view showing a result printed with a region specificationas shown in FIG. 12.

FIG. 15 is a block diagram of an image processing system in anotherexample.

FIG. 16 is a flowchart of the operation in a system control unit 16 asshown in FIG. 15.

FIG. 17 is a view showing a display screen on a monitor 14.

FIG. 18 is a block diagram of an image processing system in anotherexample.

FIG. 19 is a flowchart of the operation in a system control unit 16 asshown in FIG. 18.

FIG. 20 is a block diagram of an image processing system in anotherexample.

FIG. 21 is a block diagram of an image processing system in anotherexample.

FIG. 22 is a configuration view of a rotation filter 75 as shown in FIG.21.

FIG. 23 is a flowchart of the image pick-up as shown in FIG. 21.

FIG. 24 is a block diagram of an image processing system in anotherexample.

FIG. 25 is a flowchart of the operation in a system control unit 16 asshown in FIG. 24.

FIG. 26 is a block diagram of an image processing system in anotherembodiment.

FIG. 27 is a block diagram of an image processing system in anotherembodiment.

FIG. 28 is a view showing the movement of an image in the timedirection.

FIG. 29 is a view showing a blurred image displayed on the monitor 14.

FIG. 30 is a view showing the blurred image printed by a printer 18.

FIG. 31 is a view showing the image stored in a first field of imagestorage unit 12.

FIG. 32 is a view showing the image stored in a second field of imagestorage unit 12.

FIG. 33 is a flowchart of the operation in a system control unit 16 asshown in FIG. 27.

FIG. 34 is a flowchart of the operation in the system control unit 16 asshown in FIG. 27.

FIG. 35 is a view showing detected movement vectors.

FIG. 36 is a view showing the image in the first field after thecorrection for the blurring.

FIG. 37 is a view showing the image in the second field after correctionfor the blurring.

FIG. 38 is a view showing a printed image image after the correction forthe blurring.

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

The preferred embodiments will be described below in detail withreference to the drawings.

FIG. 1 is a block diagram of an image processing system in one exampleof the present invention. 11 is an image pick-up unit consisting of avideo camera, 12 is an image storage unit constituted of a semiconductormemory, for example, for storing the image information from the videocamera 11, 13 is a monitor output screen changeover switch, 14 is amonitor, and 15 is a power supply unit for supplying the power to eachunit. 16 is a system control unit for controlling the operation of eachunit, which is constituted of CPU, RAM, and ROM (not shown). The RAM isused as a work area for the CPU, and the ROM has written the contents ofcontrol operation or the message data to be displayed on the monitor. 17is an operation unit for operating the system control unit, comprising ashutter button 17 a for starting the storage of image, a print button 17b for starting the print of stored image, and a cancel button 17 c forcancelling the stored image to reset the system to a photographing waitstate. 18 is a video printer such as a thermal printer, or a bubble jetprinter for discharging the ink by the use of the pressure of bubblesgenerated by the heat. 19 is a detector for detecting the input of acoin.

FIG. 2 is an external view of this example. 20 is a lighting forlighting an object, such as a fluorescent lamp. 21 is a coin slot.

A flowchart of the operation in the system control unit 16 of anelectronic photo system having the above configuration is shown in FIG.3. If the coin detector 19 detects a coin, a coin insertion signal issent to the system control unit 16 (step S1). The system control unit 16which has received the coin insertion signal sends a signal to the powersupply unit 15 to start the supply of the electric power to each unit(step S2). Next, the switch 13 is changed to the camera side to displayan image being currently picked up directly on the monitor 14 (step S3).If the shutter button 17 a of the operation unit 17 is depressed (stepS4), the image being picked up at that time is stored as a still imageinto the image storage unit 12 (step S5).

Next, the switch 13 is changed to the storage unit side to display thestored image on the monitor 14, so that the user can confirm the imageto be printed (step S6). If the print button 17 b of the operation unit17 is depressed (step S7), the stored image is printed with the videoprinter 18 (step S8). After the completion of the print, a printtermination signal is sent from the video printer 18 to the systemcontrol unit 17, and further a signal is sent to the power supply unit15 to turn off the supply of the power to each unit (step S9). Then theoperation is terminated. At step S7, if the cancel button 17 c, ratherthan the print button 17 b, is depressed, the operation proceeds to stepS10 to be placed in a storing wait state, while if the cancel button 17c is not depressed, the operation proceeds to step S6 to be placed in aprinting wait state (step S10).

It will be appreciated that a photograph can be taken in a correctattitude such that if the shutter button 17 a of the operation unit 17is depressed in photographing, an image being currently picked up isstored under the control of the system control unit 16 when apredetermined count value is reached by counting up with a countercontained within the system control unit 16.

It will be also appreciated that a photograph can be taken in a correctattitude such that the shutter button 17 a of the operation unit 17 isdisposed at the foot of the photographer to depress the shutter button17 a with his foot. Further, the flash photography can be implemented bythe use of a flash lamp as the lighting 20.

Thereby, it is possible to obtain a more favorable picture because ofthe effective measures against the pollution, the easy maintenance, ashortened time for the completion of a picture, and the savings of printcost and print sheets.

Another example will be described below.

FIG. 4 is a flowchart showing the operation of an image processingsystem in another example of the present invention. The block diagram ofthis example is the same as in FIG. 1. This example allows the samepicture to be printed on plural sheets. The steps S1 to S10 are the sameas in FIG. 3, and the explanation will be omitted. After the storedimage has been printed at step S8, a timer within the system controlunit 16 is turned on (step S11), and a message notifying whether or notthe currently stored image should be further printed (e.g., “Insert acoin if one more sheet is printed”) is displayed on the monitor 14 (stepS12). If the coin is detected, the operation proceeds to step S6 to beplaced in a printing wait state (step S13). If the coin is not detectedat step S13, it is examined whether or not a predetermined time haspassed with the timer of the system control unit 16 (step S14). If thepredetermined time has not passed at step S14, the operation proceeds tostep S12 to wait for the input of a coin, while if the predeterminedtime has passed, a signal is sent from the system control unit 17 to thepower supply unit 15 to turn off the power supply for each unit (stepS15). Then the operation is terminated.

If the inserted coin is detected at step S13, the stored image isdisplayed on the monitor 14 (step S6), and the operation is placed in await state for a print instruction signal of stored image (step S7).

With this configuration, it is possible to print a plurality of picturesfor a favorable image which has been once stored.

It will be appreciated that a plurality of pictures for a favorableimage can be obtained in such a way that if the print button 17 b of theoperation unit 17 is depressed after photographing, the system controlunit 16 a makes the control so that a predetermined number of sheets areprinted.

Next, another example of the present invention will be described.

FIG. 5 is a block diagram of an image processing system showing anotherexample of the present invention. 11 to 19 are the same as in FIG. 1.

30 is a sheet-fed unit, 31 is a communication unit for communicatingwith a control center via a telephone line when the accident occurs, and32 is the telephone line.

FIG. 6 is a block diagram of a centralized supervisory system whichmakes the centralized supervision over a plurality of image processingsystems. 40 is a communication unit for communicating with a pluralityof image processing systems via the telephone line 32, and 41 is acontrol unit for controlling the centralized supervisory system. 42 is astorage unit for storing the status of each image processing system, ormap data indicating the location of the nearest available imageprocessing system when the accident may occur in the image processingsystem. 43 is a monitor for displaying the status of each imageprocessing system under the control of the control unit 41.

A flowchart of the operation in the control unit 16 of the imageprocessing system with the above configuration is shown in FIG. 7. Ifthe coin detector 19 detects a coin, a coin insertion signal is sent tothe control unit 16 (step S1). The control unit 16 which has receivedthe coin insertion signal sends a signal to the power supply unit 15 tostart the supply of the electric power to each unit (step S2). Thecontrol unit 16 receives a status signal as shown in FIG. 8 from theprinter 18 at predetermined intervals to determine whether or not theprinter 18 is normally operating (step S2). If there is no abnormalitysuch as a shortage or jamming of paper at step S20, the normal controlis continued, and the abnormality is checked at predetermined intervals.At the normal condition, the image picked up with the video camera 11 isdisplayed on the monitor 14 (step S3), and if the shutter button 17 a isdepressed (step S4), a picked up image upon depressing is stored as astill image (step S5). And the stored image is displayed on the monitor14 (step S6). If the print button 17 b of the operation unit 17 isdepressed (step S7), the stored image is printed by the video printer 18(step S8). After the completion of the print, a print termination signalis sent from the video printer 18 to the system control unit 17, andfurther a signal is sent to the power supply unit 15 to turn off thesupply of the power to each unit (step S9). Then the operation isterminated. If the cancel button 17 c, rather than the print button 17b, is depressed at step S7, the operation proceeds to step S20 to beplaced in a storing wait state, while if the cancel button 17 c is notdepressed, the operation proceeds to step S6 to be placed in a printingwait state (step S10). If there is any abnormality such as a shortage orjamming of paper at step S20, the inserted coin is repaid (step S21), inwhich a proper code, a place code and an accident code for the imageprocessing system are sent from the communication unit 31 to thecentralized supervisory system (FIG. 3) within the control center (stepS22).

The control unit 41 of the centralized supervisory system, which hasreceived the accident contents displays the proper code, the place nameand the accident contents for the abnormal image processing system onthe monitor 43. And the status content of the image processing systemwithin the storage unit 42 is rewritten into a disenabled state toretrieve the nearest available image processing system. Based on aretrieved result, map data indicating the location of installed imageprocessing system which has been prestored within the storage unit 42 issent through the communication unit 40 to the image processing systemwhich has caused the accident.

A schematic circuit configuration of the communication unit 31 is shownin FIG. 9. 55 is an accident informing control signal, in which if thissignal is turned on, the CPU 53 turns on a line connection controlsignal 54 to instruct a network control unit (NCU) 50 to connect theline. Next, the CPU 53 reads a telephone number of the control centerprewritten in a nonvolatile memory such as EEPROM 56, and instructs aDTMF generator 54 to output a DTMF (dual tone multi frequency) codecorresponding to its number in sequence by the number in accordance withthe specification of the line. If the line is connected to the controlcenter, the centralized supervisory system automatically respondsthereto so that a sinusoidal wave signal of 1 KHz is sent to thetransmission side. A band pass filter (BPF) 58 of the communication unit31 extracts the sinusoidal wave of 1 KHz, and an A/D converter 59converts the detected level into the digital form. The CPU 53 judgesthat the line is connected to the control center if the digital value isequal to or more than a predetermined value, so that the proper code,the place code of installation, and the code of accident contents forthe image processing system are read out in sequence from the EEPROM 56,and the DTMF code is sent along with an error correction code added atthe last. If they are normally received in the control center, thecentralized supervisory system generates a sinusoidal wave signal of 1KHz to notify the transmission side of the normal reception. Thecommunication unit 31 turns off the line if the 1 KHz signal isreceived. The centralized supervisory system displays a booth number, aninstallation place name, and the accident contents on the monitor 43 tobe notified to the supervisor.

The communication unit 16 of the image processing system receives mapdata of the nearest available image processing system from thecentralized supervisory system and stores them into the image storageunit 12 (step S23). The map is displayed on the monitor 14 (step S24),and if the print button of the operation unit 17 is depressed (stepS25), it is checked whether or not there is any print sheet (step S26),where if there is any print sheet, the received data is printed (stepS27). The control operation at steps S24 to S27 is continued if theimage processing system is abnormal, and upon returning to the normalcondition, the operation is reset to perform the control from step S1.

Note that the available image processing systems can be output with theexpression of words.

In this way, as the system can inform the control center of theabnormality occurring in the image processing system, if any, theperiodic round inspection for the image processing system can bedispensed with. As the maps for other available image processing systemscan be displayed, the user can find out the available image processingsystem without searching about. As the coin is repaid even if anyabnormality may occur during the control, there is no loss in spendingthe money.

Next, another example will be described.

FIG. 10 is a block diagram of an image processing system in anotherexample of the present invention. 11 is a pick-up unit consisting of avideo camera, 12 is an image storage unit constituted of a semiconductormemory, for example, capable of reading and writing the objectinformation from the video camera 11, the image storage unit beingcapable of storing the 640 pixels in the x direction and the 480 pixelsin the y direction. The read area for the print can be represented by arectangle formed by S point (XS, YS) and E point (XE, YE) as thediagonal. XS, YS, XE, YE represent the addresses in the image storageunit, respectively. 13 to 19 are the same as in FIG. 1. 17d is a regionshift button for shifting the print region in the image. By depressingthe region button, XS, YS, XE, YE as above described will be increasedor decreased. XS, YS, XE, YE are initialized when the power is turnedon. XS, XE are incremented by one if the region shift button 17 d of theright direction is depressed, while they are decremented by one if theregion shift button 17 d of the left direction is depressed. YS, YE aredecremented by one if the region shift button 17 d of the upperdirection is depressed, while they are incremented by one if the regionshift button 17 d of the lower direction is depressed.

61 is a mark generator for generating a mark indicating the printregion, in which along with that mark, the image is displayed on themonitor 14.

A flowchart of the operation in the system control unit 16 of anelectronic photo system with the above configuration is shown in FIG.11. If the coin detector 19 detects a coin, a coin insertion signal issent to the control unit 16 (step S1). The system control unit 16 whichhas received the coin insertion signal sends a signal to the powersupply unit 15 to start the supply of the electric power to each unit(step S2). If the supply of the electric power is started, the switch 13is changed to the camera side to display a compounded image of an imagebeing currently picked up with the video camera 11 and a mark 62generated by the mark generator 61 on the monitor 14 (step S30). At thistime, the mark generator receives data (XS, YS, XE, YE) representing theprint region from the system control unit 16 as previously described,and generates the mark 62 indicating the region as shown in FIG. 12. Theposition of the mark at the start-up of the power supply can bedetermined by the initial value which the ROM of the system control unit16 has stored. The photographer shifts the mark 62 to a position ofpreferred picture composition by operating the region shift button 17 dwhile seeing the monitor 14. If the region shift button 17 d isdepressed (step S31), the system control unit 16 increments ordecrements the position data (XS, YS, XE, YE) in accordance with itsdirection and amount (step S32). The data changed at step S32 is sent tothe mark generator 61 to generate the mark in accordance with its data,and the operation proceeds to step S30, where a compounded image of animage being currently picked up with the video camera 11 and a mark 62generated by the mark generator 61 is displayed on the monitor 14. Ifthe region shift button 17 d is not depressed at step S31, the operationproceeds to the next step. If the shutter button 17 a of the operationunit 17 is depressed (step S4), the image being picked up at that timeis stored in the image storage unit 12 (step S5). Then the switch 13 ischanged to the storage unit side, and the stored image is displayed onthe monitor 14 to allow the photographer to confirm the image to beprinted (step S6). If the print button 17 b of the operation unit 17 isdepressed (step S7), the image within the print region is printed (stepS8).

The print at step S8 will be described in detail with reference to FIG.13. x, y represents the address for reading the image data from theimage storage unit 12. To begin with, x is set to XS and y is set to YS(steps S41, S42). Next, the image data at the address (x,y) is sent tothe video printer 18 and printed (step S43). And x is incremented by one(step S44), and it is checked whether or not x>XE is true (step S45). Ifx≦XE at step S45, the operation proceeds to step S43 to increment x. Ifx>XE, a line feed signal is sent to the video printer 18 (step S46) toincrement y by one (step S47). And it is checked whether or not y>YE istrue (step S48). If y≦YE at step S48, the operation proceeds to stepS41, where x is reset to XS, and the print operation is continued. Ify>YE, a print termination signal is sent to the video printer 18 toterminate the print. As a result of the print, the image as shown inFIG. 14 can be obtained.

After the completion of the print, a print termination signal is sentfrom the video printer 18 to the system control unit 17, and further asignal is sent to the power supply unit 15 to turn off the supply of thepower to each unit (step S9). Then the operation is terminated. If thecancel button 17 c, rather than the print button 17 b, is depressed atstep S7, the operation proceeds to step S30, where a compounded image ofthe image from the video camera 11 and the mark 62 is displayed, whileif the cancel button 17 c is not depressed, the operation proceeds tostep S6 to be placed in a printing wait state (step S10).

It should be noted that the picture composition can be confirmed with asimple configuration in which a fixed mark indicating the print regionof respective print size is displayed on the screen of the monitor 14,without using the mark generator 61 and the region movement button 17 d,and with the position data of print region fixed.

It will be appreciated that a photograph can be taken in a correctattitude in such a way that if the shutter button 17 a of the operationunit 17 is depressed in photographing, the image being currently pickedup is stored under the control of the system control unit 16 when apredetermined count value is reached by counting up with a countercontained within the system control unit 16.

It is also possible to change the print size by inputting the size datain addition to the position data of the print region.

In this way, as the user can confirm the photographed result before thepicture is printed, a more favorable picture can be obtained whileeliminating the wastes of photographing fee or print sheet. Furthermore,as a movable print region mark is displayed on the monitor, thecomposition of picture can be confirmed so as to be changed withoutmoving the picture.

Next, another example of the present invention will be described.

FIG. 15 is a block diagram of an electronic photo system in one exampleof the present invention. 11 is an image pick-up unit consisting of avideo camera, and 12 is an image storage unit constituted of asemiconductor memory, for example, for storing the image informationfrom the video camera 11. 13 is a monitor output screen changeoverswitch, 14 is a monitor, and 15 is a power supply unit for supplying thepower to each unit. 16 is a system control unit for controlling theoperation of each unit, which is constituted of CPU, RAM, and ROM (notshown). The RAM is used as a work area for the CPU, and the ROM haswritten the contents of control operation or the message data fordisplaying on the monitor. 17 is an operation unit for operating thesystem control unit 16, comprising a shutter button 17 a for startingthe storage of image, and a print image select button 17 e forspecifying a stored image to be printed among four stored images whichhave been stored in the image storage unit 12. 18 is a video printersuch as a thermal printer, or a bubble jet printer for discharging theink by the use of the pressure of bubbles generated by the heat. 19 is adetector for detecting the input of a coin.

A flowchart of the operation in the system control unit 16 of theelectronic photo system having the above configuration is shown in FIG.16. If the coin detector 19 detects a coin, a coin insertion signal issent to the system control unit 16 (step S1). The system control unit 16which has received the coin insertion signal sends a signal to the powersupply unit 15 to start the supply of the electric power to each unit(step S2). Next, the switch 13 is changed to the camera side to displayan image being currently picked up by the video camera 11 directly onthe monitor 14 (step S3). If the shutter button 17 a of the operationunit 17 is depressed (step S4), the image being picked up by the videocamera 11 is displayed for a predetermined time (steps S50, S51), andthe picked up image is stored into the image storage unit 12 (step S52).Next, the switch 13 is changed to the storage unit side to cause thestored image to be displayed on the monitor 14 for a predetermined time,so that the photographer can confirm the image (steps S53, S54). Thecount-up is made every time the system control unit 16 stores the image,in which it is checked whether or not the count-up has been made fourtimes, or four images have been stored (step S55). At step S55, thecounter is below four, the operation proceeds to step S50 to store theimage, while if the counter is equal to 4, the monitor is divided intofour display sections as shown in FIG. 17 to display collectively fourimages stored in the image storage unit 12 on the monitor (step S56). Byseeing a collectively displayed monitor screen, the photographer selectsthe image to be printed and then depresses the print image select button17 b of the operation unit 17. If the print image select button 17 b isdepressed to specify the image to be printed, its specified image isprinted (step S57). After the completion of the print, a printtermination signal is sent from the video printer 18 to the systemcontrol unit 17. The system control unit 17 which has received the printtermination signal sends a signal to the power supply unit 15 to turnoff the supply of the power to each unit (step S9). Then the operationis terminated.

The image storage unit 12 can store four images in this example, but thepresent invention is not limited to four images. It may be sufficient tostore a plurality of images.

It will be appreciated that the print image can be specified bydepressing the print button while the stored image is being displayed ina repetitive operation of image pick-up, storage and display in series.

In this way, by storing a picked-up image of the camera and displayingthe stored image in succession, the user can correct for his pose to bemore excellent. Furthermore, as a plurality of images are stored andcollectively displayed, and the image specified by the user is printed,the user can select a more favorable picture by the comparison between aplurality of images while eliminating the wastes of photographing fee orprint sheet.

Next, another example of the present invention will be described below.

FIG. 18 is a block diagram of an image processing system in anotherexample of the present invention. 11 is a video camera (for picking up acolor image and outputting a color image signal), 12 is an image storageunit constituted of a semiconductor memory, for example, for storing theimage information from the video camera 11, 13 is a monitor outputscreen changeover switch, 14 is a monitor, and 15 is a power supply unitfor supplying the power to each unit. 16 is a system control unit forcontrolling the operation of each unit, which is constituted of CPU,RAM, and ROM (not shown). The RAM is used as a work area for the CPU,and the ROM has written the contents of control operation or the messagedata to be displayed on the monitor. 17 is an operation unit foroperating the system control unit 16, comprising a shutter button 17 afor starting the storage of image, a print button 17 b for starting theprint of stored image, a cancel button 17 c for canceling the storedimage to reset the system to a photographing wait state, and awhite-and-black/color select button 17 f for selecting thewhite-and-black print or the color print. 18 is a video printer such asa thermal printer, or a bubble jet printer for discharging the ink bythe use of the pressure of bubbles generated by the heat. 19 is adetector for detecting the input of a coin.

70 is an image convertor for converting the color image information readout from the image storage unit 12 into the white-and-black imageinformation, and 71 is a print image changeover switch for changing thevideo printer 18 to print the color or white-and-black image.

A flowchart of the operation in the system control unit 16 of anelectronic photo system having the above configuration is shown in FIG.19. If the coin detector 19 detects a coin, a coin insertion signal issent to the system control unit 16 (step S1). The system control unit 16which has received the coin insertion signal sends a signal to the powersupply unit 15 which starts the supply of the electric power to eachunit (step S2). Next, the switch 13 is changed to the camera side todisplay an image being currently picked up by the video camera 11directly on the monitor 14 (step S3). If the shutter button 17 a of theoperation unit 17 is depressed (step S4), the image being picked up atthat time is stored as a still image into the image storage unit 12(step S5).

Next, the switch 13 is changed to the storage unit side to cause thestored image to be displayed on the monitor 14, so that the photographercan confirm the image to be printed (step S6). If the print button 17 bof the operation unit 17 is depressed, a determination is made whetherthe instruction is for a white-and-black print or color print (stepS60). If the white-and-black is selected with the white-and-black/colorselect button 17 f, the system control unit 16 changes the print imagechangeover switch 71 to the side of the image converter 70, whichconverts the color image information from the image storage unit 12 intothe white-and-black image information which is then output to the videoprinter 18 (step S61). If the color is selected with thewhite-and-black/color select button 17 f at step S60, the system controlunit 16 changes the print image changeover switch 71 to the oppositeside of the image converter 70, so that the image storage unit 12 andthe video printer 18 are directly connected, whereby the color imageinformation from the image storage unit 12 is directly output to thevideo printer 18 (step S62). Based on the image information senttherein, the color or white-and-black image is printed with the videoprinter 18 (step S8).

After the completion of the print, a print termination signal is sentfrom the video printer 18 to the system control unit 17, and further asignal is sent to the power supply unit 15 to turn off the supply of thepower to each unit (step S9). Then the operation is terminated. If thecancel button 17 c, rather than the print button 17 b, is depressed atstep S7, the operation proceeds to step S3 to be placed in a storingwait state, while if the cancel button 17 c is not depressed, theoperation proceeds to step S6 to be placed in a printing wait state(step S10).

FIG. 20 is a block diagram of an improved system of FIG. 18. A differentpoint from FIG. 18 is that the image converter 70 and the print imagechangeover switch 71 are connected at the front stage of the switch 13.Thus, if the white-and-black is selected with the white-and-black/colorselect button 17 f, the white-and-black image is displayed on themonitor 14, while if the color is selected, the color image is displayedon the monitor 14. Hence, both the color and white-and-black images canbe printed to allow the user to obtain a picture in accordance with hisdesire. Further, the white-and-black or color image to be printed can beconfirmed on the monitor.

Next, another example of the present invention will be described below.

FIG. 21 is a block diagram of an image processing system in anotherexample of the present invention. 11 is a monochrome video camera whichissues a synchronizing signal in synchronism with the read out of animage. 12 to 19 are the same as in FIG. 1. 75 is a rotation filter, 76is a motor control unit, and 77 is a stepping motor. FIG. 22 shows aprofile of the rotation filter.

R, G and B are windows having red, green and blue transmission filtersmounted, respectively, and T is an achromatic transparent window. Thevideo camera 11 picks up an image through those windows.

With such a configuration, if the white-and-black is selected with thewhite-and-black/color select button on the operation unit 17, the systemcontrol unit 16 outputs a signal indicating its selection to the motorcontrol unit 76, which controls the driving of the motor 77 so that theT window of the rotation filter 75 is positioned in front of the videocamera 11, in which the image is picked up through the T window with therotation filter held in its state (steps S71, S72). On the other hand,if the color is selected with the white-and-color select button on theoperation unit 17, the system control unit 16 outputs a signalindicating its selection to the motor control unit 76. The motor controlunit 76 controls the driving of the motor 77 in synchronism with thesynchronizing signal output from the video camera 11, so that R, G and Bwindows of the rotation filter are positioned in front of the videocamera 11 in sequence. As a result, the image passing through the R, Gand B filters from the video camera 11 is read out in sequence (stepsS73, S74, S75), in which the system control unit 16 operates on thecolor image information by composing the color images passing throughrespective filters to obtain a color image. Thereby, the white-and-blackand color image can be printed to provide a picture in accordance with adesire of the user. As the white-and-black video camera is used, a lowcost image processing system can be implemented.

Another example of the present invention will be described below.

FIG. 25 is a block diagram showing another example of the presentinvention. 11 is an image pick-up unit consisting of a video camera, 80is an external video input terminal, 81 is a video input selectchangeover switch, 82 is an external input terminal connection detectorunit, 12 is an image storage unit constituted of a semiconductor memory,for example, for storing the information of an object from the videocamera 11, 13 is a monitor output screen changeover switch, 14 is amonitor, 15 is a power supply unit for supplying the electric power toeach unit, 16 is a system control unit for controlling the operation ofeach unit, 17 is an operation unit for operating the system control unit16, 18 is a video printer which is a print output unit, and 19 is adetector for detecting the input of a coin.

A flowchart of the operation in the system control unit 16 of anelectronic photo system having the above configuration is shown in FIG.25. If the coin detector 19 detects a coin, a coin insertion signal issent to the system control unit 16 (step S1). The system control unit 16which has received the coin insertion signal sends a signal to the powersupply unit 15 to start the supply of the electric power to each unit(step S2). Next, the external terminal connection detector unit 22detects whether or not the video input is connected to the externalvideo input terminal. If the external terminal is connected (step S81),the video input select changeover switch 81 is changed to the side ofthe external video input terminal 80 to input an image signal from theexternal video input terminal 80 (step S82). If the external terminal isnot connected at step S81, the video input select changeover switch 81is changed to the side of the video camera 11 to input an image signalfrom the video camera 11 (step S83). And the input image selected atsteps S81 to S83 is displayed (step S3). If the shutter button 17 a ofthe operation unit 17 is depressed (step S4), the image being picked upat that time is stored as a still image into the image storage unit 12(step S5).

Next, the switch 13 is changed to the storage unit side to cause thestored image to be displayed on the monitor 14 so that the photographercan confirm the image to be printed (step S6). If the print button 17 bof the operation unit 17 is depressed (step S7), the stored image isprinted by the video printer 18 (step S8). After the completion of theprint, a print termination signal is sent from the video printer 18 tothe system control unit 17, and further a signal is sent to the powersupply unit 15 to turn off the supply of the power to each unit (stepS9). Then the operation is terminated. If the cancel button 17 c, ratherthan the print button 17 b, is depressed at step S7, the operationproceeds to step S3 to be placed in a storing wait state, while if thecancel button 17 c is not depressed, the operation proceeds to step S6to be placed in a printing wait state (step S10).

It will be appreciated that as shown in FIG. 26, by providing asynchronizing signal detector to issue a detection signal if it detectsa synchronizing signal for the input video signal at the external videoinput terminal 80, the system control unit 16 can control the videoinput select switch 81 to be changed to the side of the external videoinput terminal 80 upon receiving the detection signal from thesynchronizing signal detector 83.

It will be also appreciated that the image recorded on a video tape canbe printed by providing a video tape deck, instead of the external videoinput terminal 80.

In this way, since images other than those picked up by a photo boothsystem can be printed, the utilization range for the user can beextended.

Next, another example of the present invention will be described below.FIG. 27 is a block diagram of an image processing system in anotherexample of the present invention. 11 to 19 are the same as in FIG. 1. 85is a decision circuit for deciding whether or not the image stored inthe image storage unit 12 is blurred, 86 is a character generatingcircuit for generating the character for use in displaying a message onthe monitor 14, 87 is a signal amplifier for amplifying a voice signalfor the message output from the system control unit 16, and 88 is aspeaker for outputting the voice signal amplified by the signalamplifier as the voice.

Referring now to FIGS. 28 to 32, a detection method with the blurringdetector 85 will be described below. The system control unit 16 performsthe control so that if the shutter button 17 a is depressed, the imagefrom the video camera 11 at the times t1, t2 are stored in a first fieldA and a second field B of the image storage unit 12, respectively.

If the shutter button 17 a is depressed while an object is moving rightupward, the image stored in the second field memory is equal to an imageto which the object of the image stored in the first field memory hasmoved right upward, as shown in FIG. 28. Here, if the image stored inthe image storage unit 12 is directly output to the monitor 14, ablurred image is displayed as shown in FIG. 29. If the image stored inthe image storage unit 12 is output to the printer 18, the blurred imageis also printed as shown in FIG. 30.

Since the print of blurred image is not useful, as shown, adetermination is made whether or not the blurred image may be printed bydetecting the movement vector based on the images stored in the firstand second field memories. First, a block composed of m=n×n pixels isset in the image of the first and second fields A and B as shown inFIGS. 31 and 32. The value representing the correlation between theblock of interest A and the block of interest B can be obtained from thevalues of pixel Ai within a block of interest A in the first field A andthe values of pixel Bi within a block of interest B in the second fieldB, by using the following expression (see Japanese Patent PublicationGazette No. 2-52914). $C = {\sum\limits_{1}^{m}{{{Ai} - {Bi}}}}$

Note that${\sum\limits_{i = 1}^{m}x_{i}} = {x_{1} + x_{2} + x_{3} + {\ldots \quad x_{m - 1}} + x_{m}}$

With the above expression, the correlation value C between the block ofinterest A, and the block of interest B at the position corresponding tothe block of interest A with the eight blocks around the block ofinterest B can be obtained for each block, in which the position of theblock having the least correlation value C is stored, and it is decidedthat the blurring occurred in photographing if the correlation value Cbetween the blocks other than the block of interest among the nineblocks in the second field and the block of interest A is least, wherebya blurring detection signal is output to the system control unit 16.Also, when the correlation value C between the block of interest B andthe block of interest A is least, the correlation value C and a presetconstant value C_(B) are compared, in which if C>C_(B), the blurringdetection signal is output to the system control unit 16. The operationof detecting the blurring by obtaining the correlation value C betweenthe block of interest A and each block among the nine blocks in thesecond field is performed for all blocks in the first field by changingthe block of interest A from A(0, 0) block to A(1,k) block.

Note that it is possible to shorten the calculation time by limiting theblock to be operated for detecting the movement vector only to the printrange of printer. On the contrary, the unwasteful printing is enabled byaligning the print range with an integral multiple of the operationblock for the movement vector.

Next, a flowchart of the operation in the system control unit 16 of anelectronic photo system with the above configuration is shown in FIGS.33 and 34. The steps S1 to S7 and S10 are the same as in FIG. 3. If theprint button 17 b is depressed at step S7, the detection of the blurringfor the stored image as previously described is performed by theblurring detector 85. At step S85, if the blurring detector 85 detectsthe blurring of stored image and the system control unit 16 receives ablurring detection signal from the blurring detector 85, a message suchas “Blurring” from the character generating circuit 86 is output to themonitor 14 to inform the user of the blurring. At the same time, thechime sound or the voice such as “Blurring” is output via the signalamplifier 87 from the speaker 88 (step S87). If the print button 17 b isdepressed (step S88), after informing the user of the blurring, thestored image is printed by the video printer 18 (step S8). After thecompletion of the print, a print termination signal is sent from thevideo printer 18 to the system control unit 17, and further a signal issent to the power supply unit 15 to turn off the supply of the power toeach unit (step S9). Then the operation is terminated.

At step S88, if the print button 17 b is not depressed, the operationproceeds to step S3, where a further photograph is taken again withoutprinting of the blurred image.

At step S86, if there is no blurring, the operation proceeds to step S8,where the normal print operation is performed.

In this way, if there is any blurring in photographing, the user isalarmed before the image is printed, so that the false picture inphotographing is never printed.

Next, another example of the present invention will be described below.

This example is one of correcting for the blurring of stored image, ifany, by further developing the method of detecting the movement vectoras shown in FIGS. 31 and 32.

As previously described with the image processing system of FIG. 27, ifthe movement vector is detected for each block in the first field, themovement vector for each block is as shown in FIG. 35 so that theblurred block can be detected. The blurring detector 85 writes the imageinformation of block having the blurring dsetected in the first field tothe position corresponding to the block of the first field in the secondfield, as shown in FIGS. 36 and 37 (in the figure, 1 indicates the firstfield image, and 2 indicates the second field image). As a result, theimage in the first field remains unchanged and the image in the secondfield is the first field image for blurred image or the second fieldimage for unblurred block, as shown in FIG. 38, so that the imagewithout blurring can be printed.

In this way, if the blurring may occur in photographing, the blurringcan be corrected, and the picture without blurring can be obtained.

What is claimed is:
 1. An image processing apparatus comprising: apick-up unit for picking-up a subject; a temporal storage unit fortemporarily storing plural sets of image information picked up by saidpick-up unit during plural predetermined time periods; a display unitfor displaying the plural sets of image information stored in saidtemporal storage unit and image information from said pick-up unit, saiddisplay unit being constituted so that a subject views the display unitduring image pick-up; a control unit for performing control to causesaid temporal storage unit to store the plural sets of image informationcorresponding to the same subject picked up by said pick-up unit duringthe predetermined time periods, and to cause said display unit todisplay the plural sets of image information corresponding to the samesubject and stored in said temporal storage unit discriminatively fromthe image information from said pick-up unit; and a selector unit forselecting at least one of the plural sets of image informationcorresponding to the same subject and stored in said temporal storageunit.
 2. The image processing apparatus according to claim 1, whereinsaid temporal storage unit stores the image information for each of thepredetermined time periods.
 3. The image processing apparatus accordingto claim 1, wherein said temporal storage unit stores the plural imageinformation in the plural predetermined time periods in response to atiming at which a predetermined instruction is input.
 4. The imageprocessing apparatus according to claim 3, wherein said temporal storageunit stores the plural image information at a predetermined time afterthe predetermined instruction is input.
 5. The image processingapparatus according to claim 3, wherein the predetermined instruction isperformed by a manual input.
 6. The image processing apparatus accordingto claim 1, wherein said display unit simultaneously displays the pluralimage information stored in said temporal storage unit.
 7. The imageprocessing apparatus according to claim 1, further comprising a detectorunit for detecting money, and a controller unit for enabling anoperation of the image processing apparatus in accordance with adetection by said detector unit.
 8. The image processing apparatusaccording to claim 1, wherein said display unit is constructed such thatsaid subject can see the plural image information during image pick-up.9. An image processing method comprising: an image pick-up step, ofpicking up a subject in plural sets of predetermined time periods; atemporal storage step, of temporarily storing the picked up plural setsof image information in a temporal storage unit; a display step, ofdisplaying the plural sets of image information stored in the temporalstorage unit and image information from the pick-up unit, said displaystep being performed such that the subject views a display during imagepick-up; a control step, of performing control to cause the temporalstorage unit to store the plural sets of image information correspondingto the same subject picked up by the pick-up unit during thepredetermined time periods, and to cause the display unit to display theplural sets of image information corresponding to the same subject andstored in the temporal storage unit discriminatively from the imageinformation from the pick-up unit; and a selection step, of selecting atleast one of the plural sets of image information corresponding to thesame subject and stored in the temporal storage unit.
 10. The imageprocessing method according to claim 9, wherein the temporal storageunit stores the plural image information for each predetermined timeperiod.
 11. The image processing method according to claim 10, whereinthe temporal storage unit stores the plural image information in theplural predetermined time periods in response to a timing at which apredetermined instruction is input.
 12. The image processing methodaccording to claim 11, wherein said temporal storage step stores theplural image information at a predetermined time after the predeterminedinstruction is input.
 13. The image processing method according to claim11, wherein the predetermined instruction is performed by a manualinput.
 14. The image processing method according to claim 9, furthercomprising a recording step, of recording at least one of the pluralsets of image information selected in said selection step on a recordingmedium.
 15. The image processing method according to claim 9, wherein,in said display step, the plural image information stored in thetemporal storage unit is simultaneously displayed.
 16. The imageprocessing method according to claim 9, further comprising a detectingstep, of detecting money, and a step of enabling an operation of imageprocessing in accordance with a detection performed in said detectingstep.
 17. The image processing method according to claim 9, wherein saiddisplay step includes displaying such that the subject can see theplural image information during image pick-up.
 18. A storage medium inwhich contents of a control operation are read by an image processingapparatus, the image processing apparatus including: a pick-up unit forpicking up a subject; a temporal storage unit for temporarily storingplural sets of image information; and a display unit for displaying theplural sets of image information stored in the temporal storage unit andimage information from the pick-up unit, the display unit beingconstituted so that the subject views the display during image pick-up;and a control unit for performing a control operation to cause thetemporal storage unit to store the plural sets of image informationcorresponding to the same subject picked up by the pick-up unit duringthe predetermined time periods, and to cause the display unit to displaythe plural sets of image information corresponding to the same subjectand stored in the temporal storage unit discriminatively from the imageinformation from the pick-up unit; the contents of the control operationcomprising: an image pick-up step, of picking-up the subject by means ofthe pick-up unit in plural sets of predetermined time periods; atemporal storage step, of temporarily storing in the temporal storageunit the plural sets of image information picked up by the pick-up unit;and a selecting step, of selecting at least one of the plural sets ofimage information corresponding to the same subject and stored in thetemporal storage unit.
 19. The storage medium according to claim 18,wherein said temporal storage step includes storing the plural imageinformation for each predetermined time period.
 20. The storage mediumaccording to claim 18, wherein said temporal storage step includesstoring the plural image information in the plural predetermined timeperiods in response to a timing at which a predetermined instruction isinput.
 21. The storage medium according to claim 20, wherein saidtemporal storage step includes storing the image information at apredetermined time after the predetermined instruction is input.
 22. Thestorage medium according to claim 20, wherein the predeterminedinstruction is performed by manual input.
 23. The storage mediumaccording to claim 18, wherein the image processing apparatus furtherincludes a recorder unit for recording the plural sets of imageinformation on a recording medium, and said contents of the controloperation further comprises a recording step, of recording the selectedsets of image information on a recording medium, using the recordingunit.
 24. The storage medium according to claim 18, the plural sets ofimage information stored in the temporal storage unit are simultaneouslydisplayed.
 25. The storage medium according to claim 18, furthercomprising a step of detecting money, and a step of enabling anoperation of image processing in accordance with the detection of themoney.
 26. The storage medium according to claim 18, wherein the displayunit is constructed such that the subject views the plural imageinformation during image pick-up.
 27. The image processing apparatusaccording to claim 1, further comprising a recorder unit for recordingthe at least one of the plural image information selected by saidselector unit on a recording medium.
 28. The image processing methodaccording to claim 14, wherein said recording step is performed byprinting.
 29. The storage medium according to claim 23, wherein saidrecording step includes performing printing.
 30. The image processingapparatus according to claim 27, wherein said recorder unit performsprinting.
 31. A control method of an image processing apparatus, saidapparatus comprising a pick-up unit for picking up a subject and astorage unit for storing plural sets of image information picked up bysaid pick-up unit during plural predetermined time periods and a displayunit for displaying the plural sets of image information stored in thestorage unit and image information from the pick-up unit, the displayunit being constituted so that a subject views the display unit duringimage pick-up, said method comprising: a storage step, of storing theplural sets of image information corresponding to the same subject andpicked up by the pick-up unit during the plural predetermined timeperiods to the storage unit; a display step, of displaying the pluralsets of image information corresponding to the same subject and storedin the storage unit on the display unit discriminatively from the imageinformation from the pick-up unit; and a selecting step, of causing toselect at least one of the plural sets of image informationcorresponding to the same subject and stored in the storage unit. 32.The control method according to claim 31, wherein the storage unitstores the plural sets of image information for each predetermined timeperiod.
 33. The control method according to claim 32, wherein thestorage unit stores the plural sets of image information in the pluralpredetermined time periods in response to a timing at which apredetermined instruction is input.
 34. The control method according toclaim 33, wherein the storage unit includes storing the plural sets ofimage information at a predetermined time after the predeterminedinstruction is input.
 35. The control method according to claim 33,wherein the predetermined instruction is performed by a manual input.36. The control method according to claim 31, further comprising arecording step, of recording the at least one of the plural sets ofimage information corresponding to the same subject and selected, on arecording medium.
 37. The control method according to claim 31, whereinthe display unit displays the plural sets of image information stored inthe storage unit.
 38. The control method according to claim 31, furthercomprising a detection step, of detecting money, and an enabling step,of enabling an operation of image processing in accordance with adetection performed in said detecting step.
 39. The control methodaccording to claim 31, wherein the display unit displays the image in amanner that the subject can see the plural sets of image informationduring image pick-up.
 40. The control method according to claim 36,wherein said recording step is performed by printing.